TANGENT BUNDLES TO REGULAR BASIC SETS IN 
HYPERBOLIC DYNAMICS 



LUCHEZAR STOYANOV 

Abstract. Given a locally maximal compact invariant hyperbolic set A for a C 1 flow or diffeomorphism on a 
Riemann manifold with C 1 unstable laminations, we construct an invariant continuous bundle of tangent vectors 
to local unstable manifolds that locally approximates A in a certain way. 

1 Introduction 

o 

Let M be a C 1 complete (not necessarily compact) Riemann manifold M and let A be a basic set 
for a C 1 flow (f>t : M — > M or a C 1 diffeomorphism / : U — > f(U) C M, where U is an open 
neighbourhood of A in M. Let E u (x) and E s (x) (x G A) be the tangent spaces to the local stable 
and unstable manifolds W*(x) and W"(x) of size e > 0, respectively (see Sect. 2). We say that 
4>t has C 1 unstable laminations over A if the map A 3 x i— > E u {x) is C 1 , i.e. at each x G A this 
map has a linearization that depends continuously on x. 
Q | Given x G A, let k x > 1 be the minimal integer such that there exist 5 X G (0, e) and a /c^- 

dimensional C 1 submanifold of W"(x) such that A n W$ (x) C S x . We will then say that S x 
is a u-submanifold of minimal dimension at x and size <5 X . In general S x is not (locally) unique, 
however it turns out that, under certain regularity conditions, its tangent space T X S X is uniquely 
determined, invariant and continuous: 



in 



Theorem 1. Assume that A is a basic set for the flow <pt (or the diffeomorphism f) and the local 
■ unstable laminations over A are C 1 . Then there exists an integer k = k u > 1 and a continuous 

dcj)t-invariant (or df- invariant, respectively) distribution E\(x), x G A, of k- dimensional linear 
spaces such that for any x G A we have k x = k, E^(x) C E u (x) and T X S X = E\{x) for any 
u-submanifold S x of minimal dimension at x. Moreover, the distribution Ej[ is invariant under 
the linearizations of the local stable holonomy maps, as well. 



o 
o 



X 



We refer the reader to Sect. 2 for the definition of the local stable holonomy maps. 
In a similar way one defines s-submanifolds of minimal dimension at x G A, and a result 
similar to the above holds for these. 

Remark 1. It is easy to see that all vectors in E u (x) that are tangent to the basic set A belong 
to E^(x). However, in general the span of these tangent vectors could be a proper subspace of 
E\(x) - see Example 2 in Sect. 4 below. 

The motivation for the introduction of the bundles E^ s comes from |St2| which deals with 
Dolgopyat type spectral estimates ([D]) for Axiom A flows on basic sets, where one has to take 
into account some fine geometric properties of basic sets. As it turns out there, in certain cases 
when the basic set A is 'relatively small', considering the tangent maps dcj>t over the whole bundle 
E u (or E s ) does not say enough about the dynamics of the flow near A. So, it appears, restricting 
dipt over the smallest possible invariant subbbundle of E u would be beneficial, and it is natural 
to believe that this might be the case in some other situations, as well, particularly when the 
dimension of the spaces E u (x) (or E s (x)) is large. 

In Sect. 3 below we prove Theorem 1 for flows; for diffeomorphisms the argument is very 
similar. Some basic definitions are given in Sect. 2, while Sect. 4 contains two examples. 



1 Although in [St2] we found a way around the problem by different means. 
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2 Preliminaries 



Let M be a C 1 complete (not necessarily compact) Riemann manifold, and fa ■ M — > M (t G R) 
a C 1 flow on Af . A (^-invariant closed subset A of M is called hyperbolic if A contains no fixed 
points and there exist constants C > and < A < 1 and a (^-invariant decomposition T X M = 
E°{x)®E u {x)®E s {x) of T X M (x G A) into a direct sum of non-zero linear subspaces, where E°(x) 
is the one-dimensional subspace determined by the direction of the flow at x, ||d<£t(ti)|| < C A* ||u|| 
for all u G E s (x) and t > 0, and ||d<£ t (u)|| < C A - * for all u G E u (x) and i < 0. Here || • || is 
the norm on T X M determined by the Riemann metric on M. 

A non-empty compact ^-invariant hyperbolic subset A of M which is not a single closed orbit 
is called a basic set for fa if fa is transitive on A and A is locally maximal, i.e. there exists an 
open neighbourhood V of A in M such that A = C\teM.fa(V). 

From now on we will assume that A is a basic set for the flow fa. For x G A and a sufficiently 
small e > let 

W e s (x) = {yeM: d(fa(x), fa{y)) < e for all t > , d(fa{x), fa{y)) ^ t ^oo } , 

W?(x) = {yeM: d(fa(x), fa{y)) < e for all t < , d(fa(x), fa(y)) ^-oo } 

be the (strong) stable and unstable manifolds of size e. Then E u (x) = T x W^(x) and E s (x) = 
T x W e s (x). 

Assuming ei G (0, eo] is sufficiently small, for any x G A and y G An W e s (x) the local holonomy 
map T~L X : AnW^(x) — > AnW e "(y) along stable laminations is well-defined and uniformly Holder 
continuous (see e.g. [PSW]). Recall that the map 1-L V X is defined as follows. Given z G An W^Ax), 
there exist unique z' G W^(z) and y' G W™ (y) such that fa(z') = y' for some tGR, \t\ < eo- 
Then we set H%(z) = y'. Under the additional condition that the unstable laminations are C 1 , 
the maps H% are C 1 as well (see e.g. Fact (2) on p. 647 in [Ha| ). That is, for each z G An W e "(x) 
the map U y x has a linearization L y x {z) : E u (z) — ► E u {U y x {z)) at z 6 Afl W 6 " (x) and ||L|(«)|| < C 
for some constant C > independent of x, y and z. 

3 Proof of Theorem 1 

So, assume that fa : M — > M (t G R) is a C 1 flow on M and A is a basic set for <^. 

By Whitney's Theorem (see e.g. [M]), the stable holonomy map T~L% has a C 1 extension 
Ul : ^(x) — >« W? (y) with H^ll <Con ^(x). Since ([(^(x))- 1 !! = (((^(x))- 1 !! = 
\\dHy(y)\\ < C ; it follows from the Inverse Function Theorem that there exists 62 G (0, ei] such 
that 

HI : WHx) — )- ^TC(x)) C W? (y) 

is a diffeomorphism for all x G A and all y G A n W/ (x). 

Let A; x (x G A) be the integers introduced in Sect. 1. Set k = min^gA k x , and fix an arbitrary 
Xo G A with k XQ = k. 

Lemma 1. k x = k for every x G A. Moreover, there exist 5 > and for every x G A a 
k-dimensional C 1 submanifold S x ofW^{x) such that A n Wg(x) C S x . 

Proof. First, notice that if S x is a C 1 submanifold of Wg(x) of minimal dimension such that 
A n Wg(x) C 5a; for some x G A, then for any y G A n W^(x), 7i x (S x ) is a C 1 submanifold of 
W™(y) with A n Wg/ C (y) C H%(S X ), so k y < k x . Similarly, k x < k y , so k x = k y . Moreover, we 
can choose the same 5 > for all y G A n W£ (x). 
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Let S — 

be a u-submanifold of Wg(xo) of minimal dimension such that ACiW^xq) C 5 for 
some 5 > 0. Given z G A, for every sufficiently large t > we have 0t(An Wg, 2 (xo)) n W/^z) 7^ 
(see e.g. [KHj ). Take t > with this property so large that ^ is expanding on W^ 2 (xq), i.e. 
d(<t>t(p) , </>t(<l)) > d(x,y) for all p, 5 G Wjy 2 (a;o). Let z' = <f>t{x) G W/^z) for some x G AnWL(io). 
Since = 5 D W^z) cSn W£{xq), S x contains A n W%, 2 (x) and dim(£ x ) = k < k x , it follows 
that k x = k and S x is a u-submanifold of minimal dimension at x and size 6. 

It now follows that k z > = k and, since <f>t is expanding on W^ 2 (x), there exists a u-submanifold 
of minimal dimension at z' of size 8/2. The remark in the beginning of the proof now shows that 
k z = k z / = k, and there exists a u-submanifold of minimal dimension at z of size 5/(2C). ■ 

Lemma 2. For any x G A and any too u-submanifolds S and S 1 of minimal dimension at x we 
have T X S = T X S' . 

Proof. Let S and S' be u-submanifolds of minimal dimension k at x for some 16 A, Take 5 > 
so small that A n ^(x) C S and A n W a u (x) C S". 

Assume that T X S \ T X S' 7^ and fix an arbitrary v G T X S \ T X S' . Then we must have 
n = dim(W^(x)) > k. Choosing a smaller 5 > if necessary and using an appropriate submanifold 
chart for S' about x in Wg(x) one constructs a C 1 submanifold S" of W^(a?) such that dim(5") = 
n-1, S' C S" and v £ T X S" . Then T X S + T X S" = E u {x) = T x (wf(x)), so the submanifolds 
S and S" are transversal at x (see e.g. |GPj ). Consequently, there exists 5' G (0,5] so that 
5'" = SriS"riWg,(x) is a submanifold of Wgi(x) of dimension at most fe-1. Since AfW^x) C 5'", 
this is a contradiction with the minimality of k = k x . 

Thus we must have T X S C T^S" and similarly T X S' C T X S. ■ 

Proof of Theorem 1. For any 16 A define E^(x) = T X S, where S is an arbitrary u-submanifold 
of minimal dimension at x. By Lemma 2, the definition is correct. Moreover, E\(x) C E u (x) 
and T X S X = E^(x) for any u-submanifold S x of minimal dimension at x. The latter implies 
E\(4> t (x)) = d<f>t(x) ■ E\(x) for any iel and any x G A. 

It remains to show that the map : A 3 x i-> E^(x) is continuous. Fix for a moment 
z G A and let be an u-submanifold of minimal dimension at z. Then for any t G 1 with a 
sufficiently small \t\, (j)t(S z ) is an u-submanifold of minimal dimension at z' = <f>t{z), so E^(z') = 
T z i (4>t(S z)) = d(f>t(z) ■ (T Z S Z ) depends continuously on z' = 4>t(z). That is, 3> is continuous along 
the orbit of z. 

Next, choosing a sufficiently small (5 > 0, for z' G W^^flA we have z' G S^, so E^(z') = T z /S z , 
and therefore $(z') = E\(z') depends continuously on z' G WJ^z) n A. 

Finally, for z' G W£(z) n A, (S z ) is an u-submanifold of minimal dimension at z', so 
= dH z (z) ■ (E\(z)) , and therefore $(z') = E\(z') depends continuously on z' G W^(z)C\A. 
The above and the continuity of the local product near z implies that is continuous at z. ■ 

4 Examples 

We use two very well known kind of flows to give: 1) a non-trivial example where k u < dim(E u ), 
and 2) an example where the span of the tangent vectors in E u (z) to A at z form a proper subspace 
of Ej[(z) (for any z G A). We use open billiard flows for the first example and geodesic flows on 
hyperbolic manifolds for the second. In higher dimensions both kind of flows should provide a 
great variety of non-wandering sets with complicated geometric (and metric) structures (see e.g 
[Ka| ) . however it appears they would not be easy to investigate. It is quite possible that one could 
use other models that are easier to describe to get similar examples. 



3 



There are various possible ways to define tangent vectors to a subset of a manifold. Here 
we use the most straightforward one. Given z G A, let exp" : E u (z) — > W^(z) and exp^ : 
E s {z) — > W^ Q (z) be the corresponding exponential maps. A vector b G E u {z) \ {0} is called 
tangent to A at z if there exist infinite sequences {v^} C E u (z) and {t m } Cl \ {0} such that 
exp"(i m ti( m )) £ An W"(z) for all m, in m ) — >■ b and t m — s> as m — > oo. It is easy to see that a 
vector b G E u (z) \ {0} is tangent to A at z iff there exists a C 1 curve z(i), < t < a, in W™(z) 
for some a > with z(0) = z, i(0) = b, and z(i) G A for arbitrarily small t > 0. Denote by E u {z) 
the set of all non-zero tangent vectors v G E u (z) to A at z. Tangent vectors to A in E s (z) and 
the set E s (z) are defined similarly. Clearly the sets E u ' s (z) are non-empty and (^-invariant and 
E u,s {z) C E u,s {z). However in general the span of E u,s (z) does not coincide with E u,s (z) — see 
Example 2 below. 

Open Problem. Under the assumptions in Sect. 1, assume that k u < dim(E u (z)) (or k s < 
dim(P s (z))), z G A. Does there always exist a C 1 submanifold M' of M of positive codimension 
and an open neighbourhood U of A in M such that 4>t(U n M') C M' for all t G R? 

One would expect the answer to be negative, however at this stage we do not have examples 
to prove this. Example 1 below is non-trivial in a certain sense, and in fact might be good enough 
to answer the above question in the negative, however we do not go that far here. 



4.1 Open billiard flows 

Let K be a subset of R n (n > 2) of the form K = K\ U if 2 U . . . U , where iQ are compact 
strictly convex disjoint domains in R n with C r boundaries Tj = dKi (r > 2) and ko > 3. Set 
£1 = M. n \ K and T = dK. We assume that K satisfies the following no-eclipse condition: for 
every pair Ki, Kj of different connected components of K the convex hull of Ki U Kj has no 
common points with any other connected component of K. With this condition, the billiard flow 
(fit defined on the cosphere bundle S*(Q) in the standard way is called an open billiard flow. It 
has singularities, however its restriction to the non-wandering set A (the set of those x G S*(Q) 
such that the trajectory {<fit(%) : t G M} is bounded) has only simple discontinuities at reflection 
point^l. Moreover, A is compact and (fit is hyperbolic and transitive on A. Finally, it follows from 
[St3j that when the minimal distance between distinct connected components of K is relatively 
large compared to the maximal sectional curvature of dK the open billiard flow on A satisfies a 
certain pinching condition which implies that the (un)stable laminations over A are C . 

In the following example we will use the natural symbolic coding of the open billiard. Let 
A be the ko x ko matrix with entries A(i,j) = 1 if i 7^ j and A(i, i) = for all i, and let 
be the set of all sequences 77 = {r]j)JL_ 00 of integer numbers 1 < rjj < ko such that rjj 7^ Vj+i 
for all j G Z. Let pr x : S*(Q) — > be the natural projection. Given £ G Ha., let (Pj(0)?L-oo 
be the successive reflection points of the unique billiard trajectory in the exterior of K such 
that Pj(€) G K t] for all j G Z (see e.g. [Bilj). Define the map $ : S A — > A n S% K (n) by 
= (P (£), - Po(£))/llA(6 - Pb(^)lf)- Then $ is a bijection such that $ o a = B o $, 

where B : A n Sq K {Q) — > A n 5^(0) is the billiard ball map from boundary to boundary, and 
a is the shift map on S^. 

2 Notice that the natural projection of t on the quotient space S*(Q)/ ~, where ~ is the equivalence relation 
(q, u) ~ (p, to) iff g = p and w = worg = pG Sif and v and w are symmetric with respect to T q (dK), is continuous. 
Moreover whenever both x and 4>t(%) are in the interior of S*(Q) and sufficiently close to A, the map y 1— > <f>t(y) is 
smooth on a neighbourhood of x. It follows from well-known results of Sinai that A is a hyperbolic set for <f> t , and 
it is easily seen that A is the maximal compact ^-invariant subset of S*(Q). Moreover, it follows from the natural 
symbolic coding for the natural section of the flow that the periodic points are dense in A, and <j>t is transitive on 
A. Thus, A is a basic set for (f>t and the classical theory of hyperbolic flows applies (see e.g. Part 4 in |KH] V 
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Example 1. Assume that n = 3 and there exists a plane a such that each of the domains Kj is 
symmetric with respect to a. Setting K' = K R a and Q' = R a, it is easy to observe that every 
billiard trajectory generated by a point in A is entirely contained in a. That is, A = A', where A' is 
the non-wandering set for the open billiard flow in Q'. Thus, dim(E^(z)) = 1 < dim(E u (z)) = 2 
for any z G A. This example is of course trivial, since A is contained in the flow-invariant 
submanifold S*(Q') of S*(Q). 

However with a small local perturbation of the boundary dK of K we can get a non-trivial 
example. Choosing standard cartesian coordinates x,y,z in M 3 , we may assume that a is given 
by the equation z = 0, i.e. a = R 2 x {0}. Let pr x : S*(R 3 ) ~ M 3 x S 2 — ► M 3 be the natural 
projection, and let C = pr 1 (A). We may choose the coordinates x,y in the plane a = {z = 0} 
so that the line y = is tangent to K[ and K 2 and K' is contained in the half-plane y > 0. Let 
(/i 6 and q2 G be such that [51,^2] is the shortest segment connecting K[ and K 2 . Take 
a point G dK[ close to (71 and such that the y-coordinate of y[ is smaller than that of q\. 
Consider the open arc A on dK[ connecting q\ and q[. It is clear that A R C = 0. 

Let / : M 3 — )■ M 3 be a C 1 (we can make it even C°°) diffeomorphism with fix) = x for 
all x outside a small open set U such that q\ G f/ and [/ n <9-fT' C .A. Then for any q G C the 
tangent planes T q {dK) and T q {dK) coincide. We can choose / so that Ki = f(Ki) = Ki for i > 1, 

= f(Ki) is strictly convex, jmd v{f{q)) ^ a for q G A arbitrarily close to (ft. Here v is the 
outward unit normal field to dK. 

Notice that the non-wandering set A for the billiard flow (ftt in the closure Q of the exterior of 
K in M 3 coincides with A. Indeed, let $ : — > A n S*~(Q) be the coding map for the billiard 

trajectories in and let z = (q,£,) G S^~(Q) belong to A. Then z = <I > (^) for some £ G Xa, 
so z = $(£) G A n Sq K (Q). Since any reflection point Pj(£) G C, by the choice of / we have 
that Pj(£) are the successive reflection points of a billiard trajectory in 17 and this must be the 
trajectory determined by Thus, z = z, so z G A. This argument also shows that A C A, so 

A = A C S*(a). Thus, dim(£^~(z)) = 1 < dim(£^"(z)) for any z G A. However, it is clear from 

the construction that S* (a R Q) is not invariant with respect to the billiard flow <fif Moreover, 
it is not difficult to see that there is no two-dimensional submanifold a of Q such that S*(a) is 
d^-invariant and A C S*(a) . 

Indeed, assume such a exists; then a is a union of billiard trajectories and C = pr x (A) C a. 
We will first show that a = a outside a large disk D containing K' . Changing the coordinates 
x, y in the plane a = {z = 0}, we may assume that the line y = is tangent to K' 2 and K' 3 and K' 
is contained in the half-plane y > 0. Let P2 G K' 2 and p% G K' 3 be such that [p2 5 P3] is the shortest 
segment connecting K' 2 and Clearly P2,P3 G a. Since P2 is not an isolated point in C, there 
are points in C R dK 2 arbitrarily close to p2- All of them are in a, so the curve a R 8K2 is tangent 
to dK 2 at p2- Similarly, the curve aCidK^, is tangent to at p%. Take point p 2 G aC\dK2 close 
to P2 and p' 3 G a R 8X3 close to P3 such that the y-coordinates of p' 2 and p' 3 are smaller than those 
of P2 and P3 , respectively. Consider the arc C2 on a R <9i^2 connecting j>2 and an( i the arc C3 
on aR5i^3 connecting p% and p 3 . We have (p2,V2) G A, where ^2 = (P3 —P2)/\\P3 ~P2\\- For any 
p G C2 sufficiently close to P2 and any v G <S*(a) sufficiently close to V2, the billiard trajectory 

j(jp, v) in 5*(r2) issued from (p, v) is contained in S*(a), so its projection in M 3 is contained in a. 
Thus, the first reflection point of j(p,v) belongs to C3. That is, for any p G C2 sufficiently close 
to /?2 and any v G S*(a) sufficiently close to V2, the straight line segment ray issued from p in the 
direction of v intersects the curve C3. Similarly, for any q G C3 sufficiently close to P3 and any 
w G S*(a) sufficiently close to — V2, the straight line segment ray issued from q in the direction 
of w intersects the curve C2. Replacing the curves C2 and C3 by shorter ones (i.e. replacing the 
points p 2 and p' 3 by points on C2 and C3 closer to P2 and P3, respectively), we now have that for 
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any p G C2 and any q G C3, the straight line segment [p, g] lies in a. This shows that C2 and C3 
lie in the same plane, and it is clear from the choice of C2 and C3 that this plane is tangent to a 
at P2, so it must coincide with a. Moreover, the union of the segments [p, q] with p G C2 and any 
q G C3 is part of both a and a. 

From the latter one easily derives that if D is an open disk in a containing K 1 , then a\D C a. 
Since A is a nowhere dense subset of S*(Q) (and S*(Q), as well), every point q G a \ K can 
be approximated arbitrarily well by points of the form pr 1 (^(a;, £)), where i > and (x,£) G 
5*(a \ D). This implies a \ X C a, and therefore a \ K = a, which is a contradiction with the 
definition of K and the perturbation /. Hence there does not exist a two-dimensional submanifold 
a of SI such that S*(a) is (^-invariant and A C S*(a) . 

4.2 Geodesic flows on manifolds of negative curvature 

Let A" be a complete (not necessarily compact) connected Riemann manifold of constant curvature 
K = — 1 and dimension dim(A) = n + 1, n > 1, and let cftt ■ M = S*(X) — > M be the geodesic 
flow on the unit cosphere bundle of X. According to a classical result of Killing and Hopf any 
such A is a hyperbolic manifold, i.e. X is isometric to HP 1+1 /T, where 

H n+1 = {{ Xl , . . . ,xi) E M n+1 : xi > 0} 

is the upper half-space in R n+1 with the Poincare metric ds 2 {x) = -^{dx\ + . . . + dx±) and T is 
a Kleinian group, i.e. a discrete group of isometries (Mobius transformations) acting freely and 
discontinuously on H n+1 . See e.g. [Rate] for basic information on hyperbolic manifolds. Given a 
hyperbolic manifold X = H n+1 /r, the limit set L(T) is defined as the set of accumulation points 
of all T orbits in cM n+1 , the topological closure of <9HI n+1 = {0} x W 1 including 00. 

Throughout this sub-section we will assume that T is torsion-free and finitely generated (then 
r is called geometrically finite) and non- elementary, i.e. L(T) is infinite (then L(T) is a closed 
non-empty nowhere dense subset of dW n+1 without isolated points; see e.g. Sect. 12.1 in [Rate]). 
A geometrically finite Kleinian group with no parabolic elements is called convex cocompact. If 
X is compact, then T is called a cocompact lattice. 

The non-wandering set A of ft : M — > M (also known as the convex core of X = HI n+1 /T) is 
the image in M of the set of all points of S f *(H ra+1 ) generating geodesies with end points in L(F). 
When r is convex cocompact, the non- wandering set A is compact. 

Notice that the class of hyperbolic manifolds X = H n+1 /r, with T a non-elementary convex 
cocompact Kleinian group, contains all classical and non-classical Schottky manifolds (cf. e.g. 
Sect. 12.1 in [Rate] ). In this case the (un) stable laminations of the geodesic flow over A are 
always C 1 (in fact C°°). 

Example 2. Consider the case n = 2 and let H 3 /r be a hyperbolic manifold generated by a 
non-elementary convex cocompact Kleinian group V with an "Apolonian packing" limit set L(T) 
(see e.g. [Su]). Then L(T) is a subset of M 2 such that for every x G L(T) the set of tangent 
vectors to L(T) at x is one-dimensional, while L(T) n U is not contained in an one-dimensional 
submanifold of M? for any open neighbourhood U of x in R 2 . Given z G A, the local unstable 
manifold W^(z) is given by the projection into HI 3 /T of the outward normal field to a (part of) 
a horosphere S in H 3 . The latter are just spheres in H 3 tangent to effl 3 or planes in the interior 
of H 3 parallel to dM 3 . Any z' G A n W?(z) can be identified with the point x' G L(T) which is 
just the limit at +00 of the geodesic determined by z' . It then follows that the set of tangent 
vectors in E u (z) to A at z is one-dimensional, while A n U is not contained in an one-dimensional 
submanifold of W^(z) for any e > 0, i.e. k u = 2. 
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